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We introduce a broad class of analytically solvable processes on networks. In the special case, 
they reduce to random walk and consensus process - two most basic processes on networks. Our 
class differs from previous models of interactions (such as stochastic Ising model, cellular automata, 
infinite particle system, and voter model) in several ways, two most important being: (i) the model 
is analytically solvable even when the dynamical equation for each node may be different and the 
network may have an arbitrary finite graph and influence structure; and (ii) in addition, when local 
dynamic is described by the same evolution equation, the model is decomposable: the equilibrium 
behavior of the system can be expressed as an explicit function of network topology and node 
dynamics. 
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I. INTRODUCTION 

Network structures are pervasive throughout biologi- 
cal, information, social, and technical systems. Recently 
network theory has paved the way for exploring many 
real-world large-scale networks, and describing and un- 
derstanding various processes taking place on these net- 
works lj. Examples of such processes include virus prop- 
agation in social and computer networks; the diffusion of 
innovations, opinion formation, and search processes in 
social networks; routing packets in communication net- 
works, to name just a few. Two most fundamental pro- 
cesses on networks are random walk and consensus pro- 
cess. Random walks on networks are dynamical processes 
aiming at modeling the diffusion of some quantity or 
information on networks. They can be used to model 
random processes inherent to many important applica- 
tions, such as transport in disordered media [2], neuron 
firing dynamics 3j , spreading of diseases [I] , or transport 
and search processes [SHS] • Another kind of processes on 
networks, related to random walks, are so-called "dis- 
tributed consensus processes" . In networks of dynamic 
systems (or agents), consensus means to reach an agree- 
ment regarding a certain quantity of interest that de- 
pends on the state of all dynamical systems (agents). 
Consensus problems have a long history in computer sci- 
ence and form the foundation of the field of distributed 
computing [TDHIS] . 

In this paper we introduce a broad class of analytically 
solvable processes on networks. We argue that this class 
can model various interactions on networks as well as hi- 
erarchical organization of complex systems (networks). 
An example of a process belonging to this class is a net- 
work of Markov chains: dynamics of each node is gov- 
erned with a Markov chain having arbitrary number of 



states and transition probabilities that depend on, not 
only the current states of that node, but also on the 
states of the neighboring nodes. Another example is a 
network of (heterogeneous) agents in which agreement 
between states of the agents should be reached. Yet an- 
other example is generalized random walk where walkers 
move between not only the nodes but also between the 
internal states of all the nodes. The class differs from 
previous models of interactions, such as stochastic Ising 
model |16j . cellular automata |17] . infinite particle sys- 
tem [T5], and voter model [19] ■ We show that for ho- 
mogeneous case, when each node (local) dynamic is de- 
scribed by the same evolution equation, the solution of 
the model is decomposable in the sense that it depends on 
the eigenvectors of two matrices: a matrix related to the 
adjacency matrix of the network and a matrix describ- 
ing the local dynamics. Moreover, it is shown that the 
heterogeneous model is analytically solvable even when 
the dynamical equation for each node may be different 
and the network may have an arbitrary finite graph and 
influence structure. 

The outline of this paper is as follows. In Section [TT| we 
introduce a broad class of linear processes on networks 
which we refer to as general linear processes. To present 
the ubiquity of these processes we include several real- 
world examples. Then, we split these processes in two 
main classes based on the nature of local dynamics and 
discuss each class in seperate sections. Thus, in Section 
III we look more closely into the homogeneous processes 
where the local dynamics in each node is described with 
the same evolution equation and discuss three variants 
of this class. Then, in Section IIVI we focus on the sec- 



ond class which we call heterogeneous processes where 
the local dynamics differs for each node in the network 
and again discuss three variants of this class of processes. 
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Section [V] shows how linear processes on networks can 
be used to model and/or to understand interactions on 
hierarchical complex systems. Lastly, in Section |VT| we 
conclude our paper. 



II. LINEAR PROCESSES ON NETWORKS 

In the following, we focus on undirected, connected 
and non-bipartite networks, which are described by their 
N x N symmetric adjacency matrix A — [a^], where N is 
the number of nodes. By definition, a^- is the topological 
weight of the edge ij. The strength Sj = J2j a ij °f node 
i is the total weight of the links connected to it. If the 
network is unweighted, Sj is simply the degree of node i. 
W = J2ij a ij/2 is the total weight in the network. 

The simplest dynamical processes on networks are lin- 
ear processes: 



(1) 



where the evolution of a quantity X4, associated to node i, 
is driven by B = [fey], a matrix related to the adjacency 
matrix A. Here we focus on two related linear processes: 
unbiased random walk and consensus. Both processes 
can be written in more compact form as: 

x(f+l) = Bx(t), (2) 

where x = [x\,. . . ,xn] t is column vector of length N. 
The difference between the two processes is that for ran- 
dom walk B is column stochastic, bn — a,, /so , and for 



consensus B is row stochastic, bi 
cesses converge to 



x(i) = B*x(0) 



(7T®1£)X(0) 
(7T T (g)l 7 v)x(0) 



/ Si. The pro- 
random walk 
consensus 



7rl£x(0)=7r||x(0)|| 
1jv^ t x(0) 



(3) 



where 7r is the dominant eigenvector of B, ljy is a length 
N column vector of 1, and C <g> D is a Kronecker prod- 
uct of matrices (or vectors) C and D. We see that 
the solution of consensus depends on the initial vector 
x(0), and each node's opinion converges to a mixture of 
the initial opinions in the network. However, the ran- 
dom walk solution, which gives the fraction of time ran- 
dom walkers spent in each node, depends only on the 
number of concurrent random walkers in the graph, i.e. 
ll x (0)|| — Ei=i £ j(0)- Also, the number of walkers is con- 
sistent in time, ||x(t + 1)|| = ||x(f)||, and it is usually 1, 
while in consensus processes, the aggregated opinion in 
the network changes with time and lacks consistency. 

The main purpose of this work is to generalize the 
model ([2]) and the result To do this, we assume that 
node i is not described with a scalar quantity, rather a 
vector of quantities is associated to the node. We now 



consider two main approaches that take advantage of this 
generalization. The first approach is to consider each 
node i as a complex system with local behavior described 
with equation 

Xi(t + l)=D„x i {t) (4) 

where Xj = [x\ xj...x™ l ] T is a nonnegative mi- 
dimensional column vector and Da is rrii x rrii stochastic 
matrix. Let as above B be a stochastic N x N matrix 
related to the adjacency matrix A. We allow bu ^ 0. 
bij contains information about the connection between 
nodes i and j in the network. Then, for each pair of 
nodes i and j, let Dij be an m, x rrij nonnegative matrix 
such that each row (column) of Dij sums up to 1. Ma- 
trix describes the dynamics between nodes i and j. 
Assume that the evolution of each node variables has the 
following linear form: 



A'* 



X»(*+ 1) = y^b,,ll,x,:J). 



(5) 



for all i = 1, . . -N. The second approach is to consider a 
network with N nodes, with each node i actually being a 
network with rrii internal nodes. Thus, the total number 
of nodes in this network of networks is mi + . . . + mjv- In 
this case, Dij are rrii x rrij nonnegative matrices derived 
from the internal structure (topology) of the network i as 
well as from the connections among the networks i and 
j. Again, we consider the simplest dynamical processes 
on this network of networks which is a linear process 
described with Eq. ([5]). 

In this paper we show that the model ([5| is simple 
enough so that it is analytically solvable, yet it is rich 
enough so it encounters various phenomena. In particu- 
lar, when rrii = 1 for all h the model reduces to two basic 
processes on networks: random walk and consensus. The 
model ([5]) consists of a network of nodes, each with states 
that evolve over time. The evolution of the states at a 
node depends on the current states of that node as well 
as on the states of the neighboring nodes. The graph 
structure is described by the matrix B and the influence 
structure is described by the matrix B and the matrices 
D^. Note that when bu = 1 for all i, ^ reduces to N un- 
connected systems Q. From now on, let x = [xi . . . xat] t 
be a column vector of length mi + . . . + mjv and should 
not be confused with x from model ([T]). 

We now present several examples which also serve as 
our motivation for this work. 

Example 1. In a network with N nodes, assume that 
each node i is actually a network with m, internal nodes. 
Thus, the total number of nodes in the network of net- 
works is mi + . . . + mjv- We are studying 2-step ran- 
dom walk where the walker makes a 2-step decision for 
where to go; first, it decides to jump to one of the exter- 
nal nodes having in mind the current external node, and 
then decides to jump to one of the internal nodes within 
the selected external node, this time having in mind the 
current internal node. To illustrate this further, we de- 
pict an example in Fig. [T] where the 2-step hierarchy 
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consists of countries and cities within the countries re- 
spectively. A random walker travels across cities by first 
choosing a country having in mind the current country, 
then a city within the chosen country having in mind 
the current city he is in. We denote with bij the tran- 
sition probability from country j to country i and with 
d!fj the transition probability from Z-th city in country 
j to fc-th city in country i. bu can be though of as the 
absorbing factor for country i, i.e. some countries can 
be more attractive than others and thus, more difficult 
for walkers to leave them. For convenience, we create 
matrices B = [bij] and = [dy]. Since the walker has 
to make a separate decision in each step, matrices B and 
Dij for all i,j are column stochastic. Then, encoding 
with vector Xj(i) = [x\{t) x\ (t) . . . x™* (t)] the expected 
density of random walkers in the mi cities in country i, 
the evolution of the random walker gets the form Eq. (p3|) . 



USA UK 

New York London 




P(France|France) 



FIG. 1. 2-step random walk where a walker makes a 2-step 
decision for where to go; it first chooses a country, then a city 
within that country. Dashed lines depict the probabilities for 
jumping from Paris to any other city and solid lines depict 
the transition probabilities from France to any other country. 
Labels on dashed lines (except one) are omitted for clarity. 

Example 2. In a network with N nodes, assume that 
each node i corresponds to a Markov chain with rzij states 
described by the vector Xj. We are studying a network 
of Markov chains with transition probabilities that de- 
pend on, not only the current states of that node, but 
also on the states of the neighboring nodes. To illus- 
trate this further, we depict an example in Fig. [2] where 
nodes correspond to physical locations, and each node 
can be in one of the 3 states describing the weather in 
that location : sun, rain and snow respectively. There- 
fore, each location i represents an internal Markov chain 
with mi = m = 3 states. Let Da be a column stochastic 
transition matrix for the internal Markov chain in loca- 
tion i. Thus, matrix Da describes the local dynamics for 
location i. Additionally, assume that the local weather 
can be affected by the weather in neighboring locations. 



Let bij denote the relative influence location j has on 
location i. This influence can be based on an arbitrary 
information such as proximity. Some locations have more 
stable weather that others, thus bu can denote the stabil- 
ity of the weather in location i. The r-th row in matrix 
B = [bij] contains the relative influences locations have 
on location r and, unlike in example 1, here B is row 
stochastic. Furthermore, it is not uncommon to think 
for example that snowing in a neighboring location can 
increase the local probability of rain, and not just snow. 
To include this information, we add 3x3 (m^ x rrij) col- 
umn stochastic transition matrix with d^j denoting 
the transition probability from state I in location j to 
state k in location i. Thus, matrices together with 
matrix B describes the global dynamics in the network. 
The evolution of this system can also be described with 
Eq. ([5]) . We stress again that this system differs from the 
one in example 1 since, here B is row stochastic, where 
in example 1, B is column stochastic. 




FIG. 2. Network of Markov chains describing weather dy- 
namics. Each node (physical location) corresponds to a 
Markov chain with 3 internal states: "sun", "snow" and 
"rain". Dashed lines depict the local transition probabilities. 
Solid lines depict inter-node transition probabilities (only 
those from "sun" state in node 3 are shown for clarity). Dash- 
dotted lines depict the influences neighboring nodes have on 
node 1 and are based on geographical proximity. 

Example 3. Assume a model of opinion formation in 
a network of N people where people discuss matters on 
TOj = m topics and the opinion of person i at time t is 
denoted by m-dimensional vector Xj (t) where x\ contains 
the opinion on fc-th topic. People communicate and ex- 
change their opinion with others. Since a person listens 
to (trusts) some people more than others, we use N x N 
matrix B where denotes the relative influence person 
j has on person i. Here, bu can describe the stubborn- 
ness (ressistance to other people's opinion) of person i. 
Consequently, the r-th row in matrix B = [bij] contains 
the relative influences people have on person r, and thus, 
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sums to 1. Each person's opinion is a combination of 
m topics and interactions can be more complex where 
the opinion of one topic can be influenced not only by 
opinions in the same topic, but also opinions of different 
topics as well. To incorporate this, we introduce m x m 
matrix Dij — D which describes the dynamics of how 
opinions change after interaction. More specifically, let 
the opinion on r-th topic be a weighted average of the 
opinions of other topics with the weights encoded in the 
r-th row of matrix D. Please note that unlike the first 
two examples, here matrix D (describing local dynamics) 
is row stochastic. This model can also be described with 
Eq. jjj). 

III. HOMOGENEOUS LINEAR PROCESSES 

We first consider the case: = m and D,j = D ^ I m 
where I m is m x m identity matrix. This corresponds to 
processes that are homogeneous meaning that the local 
dynamics in each node is described with the same evo- 
lution equation. Equations for i = 1, . . . N, can be 
rewritten as 

x(t + l) = (B®D)x(t) = Hx(t) (6) 

Assume that both matrices B and D are stochastic, not 
necessarily irreducible, and their dominant eigenvectors 
are it and p respectively. Also assume that tt and p are 
normalized so that ||7r|j = ||p|| = 1. Analogous to the 
random walk/consensus case, here we observe 4 models, 
for each combination of row/column stochastic matrices 
B and D. In the rest of the paper we will use several 
times the following two facts. First, if u is column vector 
and v is row vector then u <£> v — v ® u — uv; second, if A 
is irreducible column stochastic matrix then the columns 
of A°° converge to the dominant eigenvector of A. It is 
easy to see that a similar rule applies to row stochastic 
matrices if you take {A T )°° . 

A. Random walk 

Assume first that model both B and D arc col- 
umn stochastic. The process satisfies the consistency 
||x(i+ 1)|| = ||x(t)|| under no additional constraints. In- 
deed, 

N N N 

l£ £x,(t + 1) = £ £ K^nD* 3 {t) 
i=l i=l .7 = 1 

N N N 

j=l i=l j = l 

It corresponds to a random walk where ||x(0)|| walkers 
move between the internal states of all the nodes. Note 
that when the number of walkers is 1, ||x(0)|| = 1, the 
vector x = [xi . . . xn] T is a probability vector, and (|6| 



describes a Markov chain. When both B and D are irre- 
ducible, the stationary solution of the random walk is 

x(i) = F*x(0) 

-> (7T<g>l^)<g>(p<g> l^)x(O) 

= (tt <8 p) <8 (1 N <8 l^)x(O) 
= (7r®p)||x(0)|| 

Here, the equilibrium solution depends on both B and D 
and only on ||x(0)||: 

lim x?(t) = ||x(0)||7rip* (7) 

for alH = 1, 2, . . . , JV and k — 1,2, ... ,m. Note that for 
m = 1, the last equation |7]) reduces to Q). 



B. Consensus 

Assume now that both B and D are row stochastic. 
The model lacks consistency. When both B and D are 
irreducible, it corresponds to a consensus where each in- 
ternal variable of each node converges to the same value. 
Its stationary solution is 

x(t) = ir*x(o) 

-> (TT T <g> ljv) <X> (p T ® lm)x(O) 

= (tt t <x> p T ) ® (ljv ® l m )x(0) 
= l 7Vm (7r T ®p T )x(0) 

Here, the equilibrium solution depends on B and D in- 
cluding x(0): 

lim x k At) = (7r T «)p T )x(0) (8) 

t— ¥ OO 

for alH = 1, 2, . . . , TV and k = 1, 2, . . . , m. We note again 
that if m = 1, the last equation HA) reduces to 



C. Network of Markov chains 

Let B be row stochastic and D be column stochastic. 
When B and D are irreducible, this process reaches con- 
sensus with every node having the same state (vector) 

x(t) = #*x(0) 

^(7r T (8>lAr)®(p(g)l^)x(0) 
= (1 N ® p) ® (7r T ® l^)x(O) 
= K||x 1 (0)||...^||x Ar (0)||)[p...p] T 

i.e., 

lim x 4 fc (i) = (tti ||xi(0)|| ■ ■ • t^n \\x N (0)\\)pk 

t—>oo 

for alH = 1,2, ... ,N and fc = 1,2, ... ,m. Now, assume 
that ||xj(0)|| = c, Vz = 1, . . . , 2V. Under these constraints, 
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the model satisfies the consistency rule ||xj(i + l)|| = 
||xj(f)|| = c. Indeed, 

N 
3=1 

N N 

= M', x .. ,:/: = C ^K = C 

j=i i=i 

since J2j^ij ~ 1 an d = ll- If c = 1, the pro- 

cess corresponds to N Markov chains. Since ||xi(i)|| = 1 
at each node, ([6| describes a network of N Markov 
chains. Each node's state corresponds to an internal (lo- 
cal) Markov chain, but with transition probabilities that 
depend on the current states of that node and on the 
states of the neighboring nodes. With ||x,-(t)|| = c, only 
D has to satisfy irreducibility in order to reach consensus: 

lim x%(t) = cp k || b^l = cp k (9) 

J— too 

for all i = 1,2,..., N and k = 1,2,..., m. Here ||bj|| 
gives the sum of i-th row of B°° . Therefore, in a network 
of N identical Markov chains, the equilibrium solution 
does not depend on the graph topology. Another inter- 
esting fact is that this solution does not depend on the 
irreducibility of B. This has several implications. First, 
matrix B can be an arbitrary matrix. For instance, let 
us assume that the topology of the network is changing 
over time and let the matrix B(t) describe the topology 
at time t. Then we have x(t) = (B(t) ® D)x(t - 1) = 
(B(t)B(t - 1) . . . B(l) <g) D*)x(0). Since a product of two 
stochastic matrices is a stochastic matrix the equilibrium 
solution does not depend on B. Second, the convergence 
rate of the system will only depend on the second largest 
eigenvalue of D. 

Now consider the case when B is column stochastic 
and D is row stochastic. When B and D are irreducible, 
this process reaches consensus within each node's state, 
i.e. every component of a node's state vector reaches the 
same value 

x(i) = #*x(0) 

-> (tt ® 1 N ) ® (p T ® l m )x(0) 

= (tT <g) l ro ) ® (1^ <g) p T )x(0) 

= (Pi l|yi(0)|| • ■ -p m ||y m (0)||)[7Til m . . .ir N l m ] T 

i.e., 

lim arj(t) = (pi ||yi(0)|| ... p m 11^(0)11)7* 

i— >oo 

for all i = 1,2,...,N and k = 1,2, ...,m. Here, 
yfc(t) = [a;^ (<)... x^r(i)] T is a column vector of length 
N containing the fc-th component of each node's state. 

Now, assume that ||yj(0)|| = c,Vi = 1, ...,m. Under 
these constraints, the model satisfies the consistency rule 



||y 4 (t + l)j| = || yi (i)|| =c. Indeed, 

N N N 

i=i i=i j=i 

N N 

= Dy]-Xj(t)y]bij = Dcl m = cl m , 

j=l i=l 

since &y = 1 and Z?l m = l m . If c = 1, the pro- 
cess corresponds to m different Markov chains. In this 
case, the model describes a consensus between m Markov 
chains, each chain having TV states. With ||y;(i)|| = c, 
only B has to satisfy irreducibility in order to reach con- 
sensus: 

lim Xi(t) = C7T; ||dfe|| = C7Tj 
t— > oo 

for all i = 1,2, ... ,N and k — 1,2, ... ,m. Here ||dfe|| 
gives the sum of fc-th row of D°° . Therefore, in a net- 
work of N nodes, in which each node is described with 
m dimensional state vector such that every component of 
a node 's state vector corresponds to a Markov chain, the 
equilibrium solution depends only on the graph topology. 
Here the solution does not depend on the irreducibility 
of D which has implications analogous to the previous 
process. 

In fact, the two models described in this subsec- 
tion are related to each other. Indeed, let y&(i) = 
[x\(t) . . . x k N (t)] T be a column vector of length N con- 
taining the A:-th component of each node's state and let 
y = [yi . . . y m ] T be a column vector of length mN. Equa- 
tion ([6]) can be rewritten as: 

y(t + l) = (D®B)y(i) 

Remark 1. Assume that D is double stochastic. We 
now have only two models depending on B with station- 
ary solutions x\ — ||x(0)||/m and x\ — ^ ||x(0)|| /m 
when B is row and column stochastic respectively. On 
the other hand, when B is double stochastic, the station- 
ary solutions are x\ = ||x(0)|| /N and x\ = p k ||x(0)|| /N 
when D is row and column stochastic respectively. When 
both B and D are double stochastic, all four models 
collapse into one model with stationary solution x\ — 
||x(0)|| /(Nm). 

Remark 2. For D = I m , equations ([5]), for i = 1, . . . N, 
can be rewritten as m equations yjt(t + 1) = By k {t), for 
all k = 1, . . . , m. Therefore, when D = I m , the model ^ 
decouples into m models of ([T]). Similarly, when B = In, 
the model ^ decouples into N models of ([T]). 

IV. HETEROGENEOUS LINEAR PROCESSES 

In this section we focus on the processes which we 
call heterogeneous, where the local dynamics differs for 
each node in the network. Equation ([5| can be rewrit- 
ten in more compact form using the following extension 
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of Kronecker product of matrices B and Dij. Define 
H = B ® {Dij} = [Hij], where Hij = l',,l>,,. Then 
Eq. |5| becomes: 

x(t + l) = B®{Dij}x(t) = Hx(t), (10) 
or, in the equivalent form, the Eq. ^ can be rewritten 



as: 



where 



y{t + l) = Hy(t), 



Note that we can not obtain the city dynamics from coun- 
try dynamics. However, if choosing a city (the second 
step) didn't depend on the current city, but rather only 
on the current country, we can further decompose ma- 
trices into dyl^j. where is a column stochastic 
vector of length m s describing the transition probabili- 
ties from country j to the rrii cities in country i. Then 
Eq. ([5| gets the following form: 

n n 
Xi(t + 1) = ]T htfdtfl^X^t) = h n<l, H^WII (12) 



y = [yiz/2 • • ■ y mi y mi +iy mi +2 ■ ■ ■ y mi + m2 -- ■ y s \ 

xi 



X2 



is a column vector of length s = mi 
is a s x s matrix. 
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A. Random walk 

Using similar arguments as above, it can be shown 
that when B is column stochastic and each column of 
Dij sums up to 1, the model satisfies the consistency 
||x(i + l)|| = ||x(f)|| under no additional constraints. 
Moreover, H is column stochastic matrix. To see this, 
note that h rc has the value bijd\ l j with r = X)t=i m t + ^ 

and c = Yjt=i m t +i- Then, note that r does not depend 
on j and Z. Therefore, 

6* 

E^c = $>i< ! = £^£4 ! = £ 6 « = 1 

r— 1 i fc i & z 



Here, there is a clear connection between country dy- 
namics ||xj|| and city dynamics Xj. Therefore, if we have 
the country dynamics, we can obtain the city dynamics. 
Note that this equation is local in terms of country i, i.e. 
in order to obtain city dynamics (from country dynam- 
ics) for country i, the decomposition of D t j has to apply 
only for countries that point to country i. Also note that 
the decomposition of D^ for all i is satisfied by definition 
for each country j that has only one city, since the size 
of D^ will be X 1. 



B. Consensus 

Assume now that B is row stochastic and each row 
of D^ sums up to 1. Then using similar arguments as 
above, it can be shown that H is row stochastic as well. 
Further, assuming that H is irreducible matrix, one can 
show 



lim yi(t) = V^y^O) 



Assuming that H is irreducible matrix, the multiplicity 
of its dominant eigenvalue is 1 and asymptotic behavior 
of the Eq. (10 1 is determined by the eigenvector corre- 



sponding to 1, i.e. 

lim Vi (t) = ||x(0)|| 7i 

t— >oo 

for all i — 1,2, ...,s, where 7 = [71, 72, . . . 7 S ] T is the 
dominant eigenvector of H. Note that for Dij = D, 
the last equation reduces to Q). In fact, this process 
corresponds to the 2-step random walk discussed in ex- 
ample 1. Therefore, 2-step random walk can always be 
seen as a regular random walk with one transition ma- 
trix H — [bijd^j], thus treating each city as a seperate 
country. However, knowing that there are patterns of 
repetition in the probabilities, we can group cities into 
countries, i.e. we can decompose matrix H into matri- 
ces B and D^. The advantage in doing this is that, if 
we were interested in country dynamics only, instead of 
solving the full system given by Eq. |5]), we can solve a 
smaller model with N states. Indeed, 



E & y 

i=i 



| Xi (i)|| (11) 



for all i = 1, 2, . . . , s. Note again that for Dij = D, the 
last equation reduces to This proccess can be seen 
as a regular consensus with one row stochastic matrix 
H = [bijdij]. Similarly to the random walk process, we 
can take advantage of the decomposition of H by approx- 
imating the stationary solution. To do this, we solve the 
smaller system ( |TT| ) to calculate the sum of the weights 
for each external node k, i.e. I\. = ||xfc(oo)|| = J^iek^i 
for each k. Then, assuming that the internal weights are 
equal, we can obtain the approximation as 

k 1 1 lek 

where \k\ denotes the number of internal nodes in node 
k. Furthermore, the smaller the fluctuations of yi(0) 
within a node, the better the approximation. In fact, 
if yi(0) — yj(0) holds for all i,j g k and for all k, 
the approximation becomes exact regardless of whether 
the actual internal weights are equal. Note that, when 
D^ = D, this process becomes identical to the opinion 
formation model discussed in example 3. Therefore, if H 
is irreducible, the opinion formation model will reach con- 
sensus where there is a single opinion 7i2/i(0) valid for 
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every topic and every person in the network. However, 
since the model discussed in example 3 is also homoge- 
neous, we don't have to find the dominant eigenvector of 
H, but the eigenvectors of smaller matrices B and D as 
shown in Section ITlI Bl 



Network of Markov chains 



Finally we consider the case when B is row stochastic 
and each column of D^ sums up to 1. Then in general, 
the matrix H is not stochastic, however 1 is its dominant 
eigenvalue. This follows from the fact that H is derived 
from a convex combination of stochastic matrices. The 
multiplicity of this eigenvalue is tied to the structure of 
the underlying graph. If H is irreducible matrix, then the 
multiplicity of its dominant eigenvalue is 1 and asymp- 
totic behavior of the Eq. ( 10 ) is determined by the eigen- 



vector corresponding to 1. It can be also shown that in 
this case the consistency rule is satisfied at local level: at 
each node, (||x;(i + 1)|| = ||xj(i)||), and therefore, in this 
case, the model corresponds to a network of N different 
Markov chains. 

Let 7 = [71, 72, . . . 7 S ] T be the eigenvector of H cor- 
responding to the eigenvalue 1. Let «j be a stationary 
distribution of the Markov chain at node i. Then using 
similar arguments as above, it can be shown that 

Ot% = [la+l ■ ■ ■ 7a+m i ] T - 

where a = 5Zj=i m j- ^ n the special case when Dij = D, 
we have 



[7i 



•7mJ 



for all i, where 7^ = pf. for all k and p — [pi ■ ■ ■ p m } T is a 
dominant eigenvector of D. Therefore, all Markov chains 
reach consensus state, as discused in Section IIIICl Note 



that for = D, the last equation reduces to J^ty for 
c = 1. In fact, this process corresponds to the weather 
model discussed in example 2. 



V. NETWORK HIERARCHY 

Complex systems including networks often exhibit 
hierarchical organization in which the network self- 
organizes into modules that further subdivide into mod- 
ules of modules, and so forth over multiple scales [22] . 
This way, hierarchical systems evolve much more rapidly 
from elementary constituents than non-hierarchical sys- 
tems with the same number of elements (23) . Very 
often these hierarchies exhibit the concept of "near- 
decomposability" . Put as simply as possible, it is the 
degree to which the behavior of a system at any one level 
is free of the interactions on a lower level and the degree 
which its interactions are irrelevant to the higher levels 
of the system. In many cases the groups (modules) are 
found to correspond to known functional units, such as 



ecological niches in food webs, modules in biochemical 
networks (protein interaction networks, metabolic net- 
works or genetic regulatory networks) or communities in 
social networks [2"2"l EMH2T] . 

Typically, a network hierarchy is a product of dynam- 
ical processes that govern the evolution of the network. 
We now argue that the approach for studying linear pro- 
cesses on networks developed in this paper can also be 
extended to study network hierarchy. In general, two 
problems related to network hierarchy can be posed. The 
first problem consists of developing a general framework 
to study network hierarchy taking into account the pro- 
cesses on networks. The second problem aims at de- 
composing a given graph - the matrix H - into sub- 
graphs (groups) that are described by matrices B and 
Dij. Clearly this problem is very important having in 
mind how huge real networks are. 



To study the first problem, we note that the model ( 10 ) 



describes a homogeneous process occurring on 2-level hi- 
erarchical network described through the matrices B and 
D^. What is interesting is that these processes can be 
generalized to fit an arbitrary hierarchy of interactions of 
modules. More specifically, we introduce the hierarchical 
linear processes: 



x(t+l) = (...(B®{D£.}) 



B ® {Dh}, H 2 = Hi 



(13) 



{DfA, so on and 



where Hi 

Hh = Hh-i <£) {D^}, describing interactions on /i-level 
hierarchical complex systems (networks). Here, x is a 
column vector of length N, the number of elementary 
constituents in the system, and Hi is an Ni x Ni matrix 
describing the interactions occurring between N modules 
in the i-th level of the hierarchy. Assume that matrices 
Hi for all i are stochastic, irreducible and their dominant 
eigenvectors are 7r* respectively. In the special case when 
the process (13) is homogeneous (Dfj = D k ), it creates 
decomposability in the asymptotic behavior of the sys- 
tem, where the solution can be expressed as a function 
of global parameters (network topology) and local pa- 
rameters (local dynamics). Due to the homogeneity of 
the system, the solution of ( 13 ) can be expressed as a 



function of the eigenvectors n" 1 . 

The second problem, namely the problem of decompos- 
ing the matrix H into B and D^ , will be addressed only 
by considering an example. The decomposition of H has 
several advantages. In the random walk case, the station- 
ary solution is one of the most used centrality measures 
in networks and its well known variant, the PageRank 
algorithm [5D], lies at the heart of Google's search tech- 
nology. Here, the decomposition can be used to obtain a 
high-level view of stationary dynamics by lumping nodes 
into super-nodes. This reduces the size of the system, 
and thus, the time it takes to compute the solution. In 
the consensus case, on the other hand, we have shown 
that the high-level stationary solution can be used to ob- 
tain approximation for the stationary consensus value. 
The benefits we get from decomposing H are clear, but 
we still have not discussed the actual problem of decom- 



a) b) 
4,3 




6,, d 



d\ 2 *«; 




6 3 , ^31 



y=LYi y 2 y 3 y 4 y 5 J 



y=[yi+y 2 y 3 y 4 y 5 f 




y=[yi+y 2 y 3 +y 4 y 



FIG. 3. Heterogeneous random walk model with lumping. Nodes correspond to cities where each city i belongs to its own 
country i unless otherwise noted. The stationary solution vector of the corresponding lumped system is given on the bottom 
of each example, a) Regular random walk with transition matrix H equivalent to heterogeneous random walk where each city 
belongs to its own country, making B — H and Dij = 1. Solid lines depict the transition probabilities, b) Cities 1 and 2 share 
the same country, i.e. they are the first and the second city in country 1 respectively, c) Cities 3 and 4 also share a country, 
i.e. they are the first and the second city in country 3 respectively, b) and c) Dashed lines depict the country transition 
probabilities and solid lines depict the city transition probabilities. 



posing a given matrix H into B and Dij. In order to 
do so, H has to satisfy some properties. In order to un- 
derstand these properties, we present a toy graph where 
we discuss the random walk case; we omit the discussion 
for the consensus case because of the well known duality 
between the two processes. 

The graph is shown in Fig. [3] and consists of five nodes 
with directed edges denoting transition probabilities. For 
consistency, we will refer to external nodes as countries 
and internal nodes as cities, and use the same notations 
from previously, i.e. h^j denotes the transition proba- 
bility from city j to city i, bij the transition probability 
from country j to country i, and D^j the transition prob- 
ability from the l-th city in country j to the k-th city in 
country i. We start with Fig. [3^, by showing a regular 
random walk with transition matrix H. We can think of 
this model as 2-step random walk where each city is in 
its own country, with lxl matrix = 1 and B = H. 
Now assume that city 1 and city 2 belong to the same 
country, i.e. they are the first and the second city in 
country 1 respectively, and every other city belongs to 
its own country (see Fig. |3Jd). This means that the tran- 
sition probabilities from cities 1 and 2 are influenced by a 
common country decision factor bj\. To see this further, 
we start by describing the outgoing links from country 1, 
i.e. 



h A1 



^31^31 and h, 
^41^41 and h 



631 4? 



641 41 



where D31 and -D41 are 1x2 column stochatic matrices. 
This means that d\\ = dgf = d\{ = d\f — 1. Therefore 
we have 



^31 — ^32 — ^31 

ft-41 = ft-42 = &41 



(14) 



This tells us that cities 1 and 2 have the same distribution 
of transition probabilities. Furthermore, let us look at 
the internal links in country 1 

/in = &iirfii and hi\ = 611^1! 
hvx = hid\l and h 2 2 = bndU 

with matrix Dn describing the local transition probabili- 
ties. Summing hn and h 2 i and also, hi 2 and h 22 together 
with the fact that flu is column stochastic, we have 



hn + h 21 



hi 



(15) 



This means that the probability of staying within coun- 
try borders is the same regardless of whether the walker 
is currently at city 1 or 2. To sum up, Eq. (14 1 tells 



us that cities that share country j, share also the same 
outgoing probability distribution (same set of weighted 
outgoing links) to outside cities, given by bkj , for all cities 
k ^ j (assuming that each city k is in its own country k). 
Eq. ( fl5| , on the other hand, tells us that cities that share 
country j also have the same aggregated probability of 
staying within country j, given by bjj. Therefore, from 
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the country point of view, it is statistically irrelevant to 
know the actual city the walker is visiting. This con- 
clusion is supported by ( [TT| ) where nodes that share the 
same outgoing weighted links can be lumped in order to 
descrease the number of states in the system. Actually, 
this is a well known technique used in PageRank compu- 
tation where all dangling nodes (nodes with no outlinks) 
are lumped in one node |21j . This is done by solving a 
smaller system of size n + 1 (see system (111), where n is 



the number of non-dangling nodes and then its solution 
is used for one iteration of system ( 12 ) in order to get 



the ranking for the dangling nodes as well. Note that we 
can get the ranking for the dangling nodes since all other 
nodes are actually external nodes with size 1, thus the 
decomposition of is satisfied by definition. What is 
left is to look into the incoming links for country 1, i.e. 
the outgoing links of city 5 

h 15 = b 15 d\l and h 25 = b 15 djl 

By summing /i 15 and ft 2 5 and using the fact that -D 15 
is column stochastic we get the transition probabilities 
from city 5 to country 1 as 



hi5 
11 



di 



d\ 



21 



^■25 — ^15 
^15 

^15 + ^25 
«25 



'15 



'25 



This tells us that if lump cities into countries, we can 
obtain the new transitional probabilities by using simple 
normalization. The properties that cities should posses 
in order to lump them into countries are pretty strict. 
This is because we are treating all the other nodes as 
countries with a single city. However, when we have sev- 
eral countries with more than one city, these properties 
are relaxed. To show this, assume also that city 3 and 4 
are sharing the same country, i.e. they are the first and 
the second city in country 3 respectively (see Fig. [3j:). 
Then we have 



hz2 



^31^31 and hn 
^31^31 and ft-42 



b 3 idl\ 
hidH 



Summing h^i and /141 and also, /132 and /142 together with 
the fact that D31 is column stochastic, we have 



/131 + ^41 — ^32 + /142 — bsi 



(16) 



We can see that the property for lumping nodes is re- 
laxed. Eq. ( [T6| ) tells us that cities that share country j, 
share also the same aggregated probability distribution 
for outside countries, given by bij, for all countries i. 

To conclude this section, we stress that heterogeneous 
random walk processes satisfy an important property 
that allows us to lump nodes without loosing much in- 
formation about the system (see (11)). In fact, if the 
super-nodes are not sharing any links, no information 
will be lost after lumping. That is, if only regular nodes 
point to these super-nodes, we can easily restore the in- 
ternal dynamics after computing the high-level dynamics 
(see ( 12 )). We have also shown the properties that nodes 
must have in order to share the same super-node. Given 
a matrix H, the problem of finding the right partition 
of nodes, i.e. decomposing H into B and is clearly 
important. We believe this problem belongs to the class 
of NP problems, however the study of this problem is 
beyond the scope of this paper and will be discussed in 
a forthcoming paper. 



VI. CONCLUSIONS 

In conclusions, we have introduced a broad class of 
analytically solvable processes on networks. Both homo- 
geneous and heterogeneous models are analytically solv- 
able, although for homogeneous models, it was shown 
that the analytical solution is explicit function of two sets 
of parameters: one being the parameters of the network 
topology and the other being the parameters of the local 
(node) dynamics. Finally, we have shown that suggested 
framework for analysis of linear processes on networks 
can be taken as advantage and can be used to model 
and/or to understand interactions on hierarchical com- 
plex systems. 
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